Skip to content

Comments

lazy dict layout values eval#6423

Merged
onursatici merged 1 commit intodevelopfrom
os/shared-values-eval
Feb 11, 2026
Merged

lazy dict layout values eval#6423
onursatici merged 1 commit intodevelopfrom
os/shared-values-eval

Conversation

@onursatici
Copy link
Contributor

@onursatici onursatici commented Feb 11, 2026

Does this PR closes an open issue or discussion?

  • Closes #.

What changes are included in this PR?

make values child evaluation of an expression in the projection evaluation of a dict layout lazy. We want this because the current execute is assuming cpu only, with shared array we defer to the actual execute call to choose which execution it wants

What is the rationale for this change?

How is this change tested?

Are there any user-facing changes?

@onursatici
lazy dict layout values eval
7031246 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici onursatici added the changelog/performance A performance improvement label Feb 11, 2026
joseph-isaacs
joseph-isaacs reviewed Feb 11, 2026
View reviewed changes
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Feb 11, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Feb 11, 2026
@onursatici onursatici merged commit 92156f5 into develop Feb 11, 2026
93 of 104 checks passed
@onursatici onursatici deleted the os/shared-values-eval branch February 11, 2026 16:31
@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7031246 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark FineWeb NVMe failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

Benchmarks: PolarSignals Profiling

Summary

  • Overall: 1.099x ➖
  • Vortex: 1.099x ➖
  • datafusion:vortex: 1.099x ➖
  • Best: No improvements
  • Worst: polarsignals_q01/datafusion:vortex-file-compressed (1.183x)
  • Significant (>10%): 0↑ 5↓
Detailed Results Table
name PR 7031246 base 8e92de5 ratio (PR/base) unit remark
polarsignals_q00/datafusion:vortex-file-compressed 188457581 1.83946e+08 1.02452 ns
polarsignals_q01/datafusion:vortex-file-compressed 426853762 3.60679e+08 1.18347 ns 🚨
polarsignals_q02/datafusion:vortex-file-compressed 30596579 2.606e+07 1.17408 ns 🚨
polarsignals_q03/datafusion:vortex-file-compressed 431862329 4.16381e+08 1.03718 ns
polarsignals_q04/datafusion:vortex-file-compressed 13795094 1.25506e+07 1.09916 ns
polarsignals_q05/datafusion:vortex-file-compressed 19362995 1.77217e+07 1.09262 ns
polarsignals_q06/datafusion:vortex-file-compressed 25338454 2.26474e+07 1.11882 ns 🚨
polarsignals_q07/datafusion:vortex-file-compressed 17605096 1.5503e+07 1.13559 ns 🚨
polarsignals_q08/datafusion:vortex-file-compressed 506808383 4.5688e+08 1.10928 ns 🚨
polarsignals_q09/datafusion:vortex-file-compressed 16372440 1.59121e+07 1.02893 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on S3 failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-DS SF=1 on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

Benchmarks: TPC-H SF=1 on NVME

Summary

  • Overall: 1.068x ➖
  • Vortex: 1.060x ➖
  • duckdb:vortex: 1.031x ➖
  • datafusion:vortex: 1.090x ➖
  • Best: tpch_q02/duckdb:vortex-file-compressed (0.961x)
  • Worst: tpch_q03/datafusion:vortex-file-compressed (1.231x)
  • Significant (>10%): 0↑ 18↓
Detailed Results Table
name PR 7031246 base 8e92de5 ratio (PR/base) unit remark
tpch_q01/datafusion:arrow 67605125 6.32382e+07 1.06905 ns
tpch_q02/datafusion:arrow 25417634 2.35951e+07 1.07724 ns
tpch_q03/datafusion:arrow 37444659 3.71984e+07 1.00662 ns
tpch_q04/datafusion:arrow 30278368 3.07189e+07 0.985659 ns
tpch_q05/datafusion:arrow 95364700 9.05885e+07 1.05272 ns
tpch_q06/datafusion:arrow 22581274 2.04687e+07 1.10321 ns 🚨
tpch_q07/datafusion:arrow 177644248 1.697e+08 1.04681 ns
tpch_q08/datafusion:arrow 47459753 4.62576e+07 1.02599 ns
tpch_q09/datafusion:arrow 77736993 7.431e+07 1.04612 ns
tpch_q10/datafusion:arrow 58007662 5.59412e+07 1.03694 ns
tpch_q11/datafusion:arrow 11990684 1.12364e+07 1.06713 ns
tpch_q12/datafusion:arrow 66962068 5.65715e+07 1.18367 ns 🚨
tpch_q13/datafusion:arrow 56199795 5.61327e+07 1.0012 ns
tpch_q14/datafusion:arrow 28793430 2.53581e+07 1.13547 ns 🚨
tpch_q15/datafusion:arrow 57347674 5.06313e+07 1.13265 ns 🚨
tpch_q16/datafusion:arrow 25449056 2.33809e+07 1.08846 ns
tpch_q17/datafusion:arrow 94221226 7.42058e+07 1.26973 ns 🚨
tpch_q18/datafusion:arrow 174645339 1.58873e+08 1.09927 ns
tpch_q19/datafusion:arrow 56313698 3.81626e+07 1.47562 ns 🚨
tpch_q20/datafusion:arrow 50579350 3.88003e+07 1.30358 ns 🚨
tpch_q21/datafusion:arrow 267504023 2.28034e+08 1.17309 ns 🚨
tpch_q22/datafusion:arrow 22827032 2.12637e+07 1.07352 ns
tpch_q01/datafusion:parquet 110925367 1.04786e+08 1.05859 ns
tpch_q02/datafusion:parquet 92180133 8.12082e+07 1.13511 ns 🚨
tpch_q03/datafusion:parquet 90401288 8.57597e+07 1.05412 ns
tpch_q04/datafusion:parquet 61954119 5.5822e+07 1.10985 ns 🚨
tpch_q05/datafusion:parquet 182662484 1.71515e+08 1.065 ns
tpch_q06/datafusion:parquet 47093989 4.74733e+07 0.99201 ns
tpch_q07/datafusion:parquet 200696413 1.7823e+08 1.12605 ns 🚨
tpch_q08/datafusion:parquet 178800644 1.71515e+08 1.04248 ns
tpch_q09/datafusion:parquet 236414047 2.15615e+08 1.09646 ns
tpch_q10/datafusion:parquet 206871519 1.91049e+08 1.08282 ns
tpch_q11/datafusion:parquet 69468756 6.16632e+07 1.12658 ns 🚨
tpch_q12/datafusion:parquet 135886670 1.31451e+08 1.03374 ns
tpch_q13/datafusion:parquet 245634915 2.03774e+08 1.20543 ns 🚨
tpch_q14/datafusion:parquet 89742199 8.74951e+07 1.02568 ns
tpch_q15/datafusion:parquet 77028269 6.98621e+07 1.10258 ns 🚨
tpch_q16/datafusion:parquet 68136276 5.35872e+07 1.2715 ns 🚨
tpch_q17/datafusion:parquet 219682665 1.72851e+08 1.27094 ns 🚨
tpch_q18/datafusion:parquet 284843646 2.38538e+08 1.19412 ns 🚨
tpch_q19/datafusion:parquet 112478997 9.92994e+07 1.13273 ns 🚨
tpch_q20/datafusion:parquet 136295926 1.2329e+08 1.10549 ns 🚨
tpch_q21/datafusion:parquet 206136435 1.826e+08 1.12889 ns 🚨
tpch_q22/datafusion:parquet 45256557 3.98174e+07 1.1366 ns 🚨
tpch_q01/datafusion:vortex-file-compressed 60329008 5.48994e+07 1.0989 ns
tpch_q02/datafusion:vortex-file-compressed 62541294 5.62432e+07 1.11198 ns 🚨
tpch_q03/datafusion:vortex-file-compressed 36757410 2.98612e+07 1.23094 ns 🚨
tpch_q04/datafusion:vortex-file-compressed 24916644 2.12798e+07 1.1709 ns 🚨
tpch_q05/datafusion:vortex-file-compressed 98897782 8.52595e+07 1.15996 ns 🚨
tpch_q06/datafusion:vortex-file-compressed 13273362 1.11797e+07 1.18727 ns 🚨
tpch_q07/datafusion:vortex-file-compressed 110304818 9.41327e+07 1.1718 ns 🚨
tpch_q08/datafusion:vortex-file-compressed 79096637 7.16536e+07 1.10388 ns 🚨
tpch_q09/datafusion:vortex-file-compressed 101596478 8.78665e+07 1.15626 ns 🚨
tpch_q10/datafusion:vortex-file-compressed 93991091 8.43211e+07 1.11468 ns 🚨
tpch_q11/datafusion:vortex-file-compressed 23585601 2.14838e+07 1.09783 ns
tpch_q12/datafusion:vortex-file-compressed 41134701 3.69532e+07 1.11316 ns 🚨
tpch_q13/datafusion:vortex-file-compressed 36103727 3.34149e+07 1.08047 ns
tpch_q14/datafusion:vortex-file-compressed 32828041 3.04069e+07 1.07962 ns
tpch_q15/datafusion:vortex-file-compressed 30269255 2.80548e+07 1.07893 ns
tpch_q16/datafusion:vortex-file-compressed 38553618 3.63901e+07 1.05945 ns
tpch_q17/datafusion:vortex-file-compressed 87899904 7.63182e+07 1.15176 ns 🚨
tpch_q18/datafusion:vortex-file-compressed 120562183 1.08537e+08 1.1108 ns 🚨
tpch_q19/datafusion:vortex-file-compressed 38037765 3.57922e+07 1.06274 ns
tpch_q20/datafusion:vortex-file-compressed 58401863 5.26517e+07 1.10921 ns 🚨
tpch_q21/datafusion:vortex-file-compressed 111825847 1.03191e+08 1.08368 ns
tpch_q22/datafusion:vortex-file-compressed 19805618 1.76207e+07 1.124 ns 🚨
tpch_q01/datafusion:vortex-compact 65131393 6.31683e+07 1.03108 ns
tpch_q02/datafusion:vortex-compact 61785861 5.99472e+07 1.03067 ns
tpch_q03/datafusion:vortex-compact 36860484 3.43518e+07 1.07303 ns
tpch_q04/datafusion:vortex-compact 30019934 2.62914e+07 1.14182 ns 🚨
tpch_q05/datafusion:vortex-compact 94978702 8.80535e+07 1.07865 ns
tpch_q06/datafusion:vortex-compact 16225976 1.68282e+07 0.964215 ns
tpch_q07/datafusion:vortex-compact 109918996 1.00117e+08 1.0979 ns
tpch_q08/datafusion:vortex-compact 84794362 7.94374e+07 1.06744 ns
tpch_q09/datafusion:vortex-compact 103802758 9.9149e+07 1.04694 ns
tpch_q10/datafusion:vortex-compact 91090520 8.72414e+07 1.04412 ns
tpch_q11/datafusion:vortex-compact 25525050 2.40373e+07 1.06189 ns
tpch_q12/datafusion:vortex-compact 52148011 4.95169e+07 1.05314 ns
tpch_q13/datafusion:vortex-compact 41813593 4.01719e+07 1.04087 ns
tpch_q14/datafusion:vortex-compact 36545428 3.48994e+07 1.04716 ns
tpch_q15/datafusion:vortex-compact 37736467 3.66621e+07 1.02931 ns
tpch_q16/datafusion:vortex-compact 42591895 4.03596e+07 1.05531 ns
tpch_q17/datafusion:vortex-compact 89332539 8.1297e+07 1.09884 ns
tpch_q18/datafusion:vortex-compact 123453689 1.11342e+08 1.10878 ns 🚨
tpch_q19/datafusion:vortex-compact 50008774 4.85747e+07 1.02952 ns
tpch_q20/datafusion:vortex-compact 63649189 5.89317e+07 1.08005 ns
tpch_q21/datafusion:vortex-compact 126302457 1.11658e+08 1.13115 ns 🚨
tpch_q22/datafusion:vortex-compact 18264685 1.73957e+07 1.04995 ns
tpch_q01/duckdb:parquet 84104328 8.02122e+07 1.04852 ns
tpch_q02/duckdb:parquet 51383895 4.79424e+07 1.07178 ns
tpch_q03/duckdb:parquet 79532709 8.18793e+07 0.971341 ns
tpch_q04/duckdb:parquet 73874470 6.86076e+07 1.07677 ns
tpch_q05/duckdb:parquet 93221922 7.70266e+07 1.21026 ns 🚨
tpch_q06/duckdb:parquet 24060534 3.29981e+07 0.729148 ns 🚀
tpch_q07/duckdb:parquet 99094779 8.19786e+07 1.20879 ns 🚨
tpch_q08/duckdb:parquet 100732954 1.24529e+08 0.808914 ns 🚀
tpch_q09/duckdb:parquet 176207475 1.73813e+08 1.01378 ns
tpch_q10/duckdb:parquet 154243003 1.51946e+08 1.01512 ns
tpch_q11/duckdb:parquet 26831194 2.61625e+07 1.02556 ns
tpch_q12/duckdb:parquet 75117159 6.56985e+07 1.14336 ns 🚨
tpch_q13/duckdb:parquet 299348715 2.7803e+08 1.07668 ns
tpch_q14/duckdb:parquet 64715732 5.27799e+07 1.22614 ns 🚨
tpch_q15/duckdb:parquet 30182363 2.90128e+07 1.04031 ns
tpch_q16/duckdb:parquet 62832607 6.00957e+07 1.04554 ns
tpch_q17/duckdb:parquet 72242371 7.02427e+07 1.02847 ns
tpch_q18/duckdb:parquet 132727951 1.33406e+08 0.994918 ns
tpch_q19/duckdb:parquet 73038003 7.13718e+07 1.02335 ns
tpch_q20/duckdb:parquet 92890154 7.99019e+07 1.16255 ns 🚨
tpch_q21/duckdb:parquet 213955763 1.72847e+08 1.23783 ns 🚨
tpch_q22/duckdb:parquet 58453147 5.65484e+07 1.03368 ns
tpch_q01/duckdb:vortex-file-compressed 34428062 3.36199e+07 1.02404 ns
tpch_q02/duckdb:vortex-file-compressed 30817161 3.20844e+07 0.960504 ns
tpch_q03/duckdb:vortex-file-compressed 33674330 3.30437e+07 1.01909 ns
tpch_q04/duckdb:vortex-file-compressed 37167361 3.60136e+07 1.03204 ns
tpch_q05/duckdb:vortex-file-compressed 41673124 3.82765e+07 1.08874 ns
tpch_q06/duckdb:vortex-file-compressed 10048206 9.83569e+06 1.02161 ns
tpch_q07/duckdb:vortex-file-compressed 40580639 4.02e+07 1.00947 ns
tpch_q08/duckdb:vortex-file-compressed 48954023 4.61564e+07 1.06061 ns
tpch_q09/duckdb:vortex-file-compressed 87730810 8.20946e+07 1.06866 ns
tpch_q10/duckdb:vortex-file-compressed 37481973 3.66957e+07 1.02143 ns
tpch_q11/duckdb:vortex-file-compressed 15882875 1.63032e+07 0.974216 ns
tpch_q12/duckdb:vortex-file-compressed 24359083 2.31072e+07 1.05418 ns
tpch_q13/duckdb:vortex-file-compressed 40078909 3.8286e+07 1.04683 ns
tpch_q14/duckdb:vortex-file-compressed 25736446 2.37312e+07 1.0845 ns
tpch_q15/duckdb:vortex-file-compressed 19162813 1.82217e+07 1.05165 ns
tpch_q16/duckdb:vortex-file-compressed 34226037 3.26954e+07 1.04681 ns
tpch_q17/duckdb:vortex-file-compressed 27679887 2.71465e+07 1.01965 ns
tpch_q18/duckdb:vortex-file-compressed 54319676 5.35587e+07 1.01421 ns
tpch_q19/duckdb:vortex-file-compressed 31238196 3.06606e+07 1.01884 ns
tpch_q20/duckdb:vortex-file-compressed 38985228 3.86685e+07 1.00819 ns
tpch_q21/duckdb:vortex-file-compressed 106708604 1.03412e+08 1.03188 ns
tpch_q22/duckdb:vortex-file-compressed 21943455 2.046e+07 1.07251 ns
tpch_q01/duckdb:vortex-compact 39392042 3.99948e+07 0.984929 ns
tpch_q02/duckdb:vortex-compact 44093702 4.42642e+07 0.996149 ns
tpch_q03/duckdb:vortex-compact 39505343 3.77236e+07 1.04723 ns
tpch_q04/duckdb:vortex-compact 41840876 4.28352e+07 0.976788 ns
tpch_q05/duckdb:vortex-compact 45092463 4.5556e+07 0.989824 ns
tpch_q06/duckdb:vortex-compact 14053100 1.39828e+07 1.00503 ns
tpch_q07/duckdb:vortex-compact 50166264 4.89916e+07 1.02398 ns
tpch_q08/duckdb:vortex-compact 57381406 5.71641e+07 1.0038 ns
tpch_q09/duckdb:vortex-compact 96290948 9.04407e+07 1.06469 ns
tpch_q10/duckdb:vortex-compact 44372232 4.32166e+07 1.02674 ns
tpch_q11/duckdb:vortex-compact 25744295 2.2678e+07 1.13521 ns 🚨
tpch_q12/duckdb:vortex-compact 36445672 3.59202e+07 1.01463 ns
tpch_q13/duckdb:vortex-compact 44136329 4.43665e+07 0.994813 ns
tpch_q14/duckdb:vortex-compact 31806126 2.98894e+07 1.06413 ns
tpch_q15/duckdb:vortex-compact 21951502 2.09239e+07 1.04911 ns
tpch_q16/duckdb:vortex-compact 42107005 4.08713e+07 1.03023 ns
tpch_q17/duckdb:vortex-compact 31626163 2.99956e+07 1.05436 ns
tpch_q18/duckdb:vortex-compact 61667521 5.92561e+07 1.04069 ns
tpch_q19/duckdb:vortex-compact 37205596 3.5783e+07 1.03975 ns
tpch_q20/duckdb:vortex-compact 47035451 4.5648e+07 1.03039 ns
tpch_q21/duckdb:vortex-compact 119275546 1.15252e+08 1.03492 ns
tpch_q22/duckdb:vortex-compact 22686551 2.13875e+07 1.06074 ns
tpch_q01/duckdb:duckdb 18008256 1.74585e+07 1.03149 ns
tpch_q02/duckdb:duckdb 16628286 1.43888e+07 1.15564 ns 🚨
tpch_q03/duckdb:duckdb 22770710 2.21958e+07 1.0259 ns
tpch_q04/duckdb:duckdb 20984054 2.22476e+07 0.943204 ns
tpch_q05/duckdb:duckdb 24898974 2.28044e+07 1.09185 ns
tpch_q06/duckdb:duckdb 7670061 7.16412e+06 1.07062 ns
tpch_q07/duckdb:duckdb 28338471 2.67341e+07 1.06001 ns
tpch_q08/duckdb:duckdb 28121299 2.71627e+07 1.03529 ns
tpch_q09/duckdb:duckdb 64741318 6.15364e+07 1.05208 ns
tpch_q10/duckdb:duckdb 61899645 6.22305e+07 0.994683 ns
tpch_q11/duckdb:duckdb 7769437 7.72975e+06 1.00513 ns
tpch_q12/duckdb:duckdb 18162481 1.74654e+07 1.03991 ns
tpch_q13/duckdb:duckdb 41960108 4.01089e+07 1.04616 ns
tpch_q14/duckdb:duckdb 23993516 2.25657e+07 1.06327 ns
tpch_q15/duckdb:duckdb 14721376 1.43984e+07 1.02243 ns
tpch_q16/duckdb:duckdb 26720514 2.49854e+07 1.06945 ns
tpch_q17/duckdb:duckdb 19409863 1.85578e+07 1.04591 ns
tpch_q18/duckdb:duckdb 40901633 4.0308e+07 1.01473 ns
tpch_q19/duckdb:duckdb 34454727 3.22164e+07 1.06948 ns
tpch_q20/duckdb:duckdb 28029410 2.75556e+07 1.01719 ns
tpch_q21/duckdb:duckdb 67755532 6.44968e+07 1.05053 ns
tpch_q22/duckdb:duckdb 28558807 2.71678e+07 1.0512 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark FineWeb S3 failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on S3 failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

Benchmarks: Statistical and Population Genetics

Summary

  • Overall: 1.002x ➖
  • Vortex: 1.001x ➖
  • duckdb:vortex: 1.001x ➖
  • Best: statpopgen_q07/duckdb:vortex-compact (0.962x)
  • Worst: statpopgen_q07/duckdb:vortex-file-compressed (1.039x)
  • Significant (>10%): 0↑ 0↓
Detailed Results Table
name PR 7031246 base 8e92de5 ratio (PR/base) unit remark
statpopgen_q00/duckdb:parquet 230097482 2.32681e+08 0.988895 ns
statpopgen_q01/duckdb:parquet 372913820 3.70153e+08 1.00746 ns
statpopgen_q02/duckdb:parquet 688489352 6.76752e+08 1.01734 ns
statpopgen_q03/duckdb:parquet 1116841434 1.10134e+09 1.01408 ns
statpopgen_q04/duckdb:parquet 1126563258 1.13816e+09 0.989814 ns
statpopgen_q05/duckdb:parquet 746156340 7.41464e+08 1.00633 ns
statpopgen_q06/duckdb:parquet 1340920048 1.33798e+09 1.0022 ns
statpopgen_q07/duckdb:parquet 864722895 8.64224e+08 1.00058 ns
statpopgen_q08/duckdb:parquet 847711492 8.41416e+08 1.00748 ns
statpopgen_q09/duckdb:parquet 937859704 9.30131e+08 1.00831 ns
statpopgen_q10/duckdb:parquet 2154672167 2.12075e+09 1.016 ns
statpopgen_q00/duckdb:vortex-file-compressed 13106116 1.3316e+07 0.984238 ns
statpopgen_q01/duckdb:vortex-file-compressed 96461461 9.58678e+07 1.00619 ns
statpopgen_q02/duckdb:vortex-file-compressed 1190201325 1.19352e+09 0.997217 ns
statpopgen_q03/duckdb:vortex-file-compressed 2817932625 2.79658e+09 1.00763 ns
statpopgen_q04/duckdb:vortex-file-compressed 2789156045 2.8012e+09 0.995701 ns
statpopgen_q05/duckdb:vortex-file-compressed 1271469049 1.26354e+09 1.00628 ns
statpopgen_q06/duckdb:vortex-file-compressed 1923726729 1.91013e+09 1.00712 ns
statpopgen_q07/duckdb:vortex-file-compressed 191336823 1.84121e+08 1.03919 ns
statpopgen_q08/duckdb:vortex-file-compressed 199445746 1.99735e+08 0.998551 ns
statpopgen_q09/duckdb:vortex-file-compressed 2555876714 2.54951e+09 1.0025 ns
statpopgen_q10/duckdb:vortex-file-compressed 4112073900 4.09373e+09 1.00448 ns
statpopgen_q00/duckdb:vortex-compact 13138417 1.29969e+07 1.01089 ns
statpopgen_q01/duckdb:vortex-compact 89939025 9.03959e+07 0.994946 ns
statpopgen_q02/duckdb:vortex-compact 1598798522 1.57924e+09 1.01238 ns
statpopgen_q03/duckdb:vortex-compact 3210491913 3.21118e+09 0.999786 ns
statpopgen_q04/duckdb:vortex-compact 3215475312 3.20517e+09 1.00321 ns
statpopgen_q05/duckdb:vortex-compact 1605818511 1.5828e+09 1.01454 ns
statpopgen_q06/duckdb:vortex-compact 2474537293 2.47232e+09 1.0009 ns
statpopgen_q07/duckdb:vortex-compact 938129710 9.75552e+08 0.96164 ns
statpopgen_q08/duckdb:vortex-compact 981185447 1.0073e+09 0.974072 ns
statpopgen_q09/duckdb:vortex-compact 2975397497 2.96384e+09 1.0039 ns
statpopgen_q10/duckdb:vortex-compact 4696789154 4.70581e+09 0.998083 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

Benchmarks: Random Access

Summary

  • Overall: 1.002x ➖
  • Vortex: 0.980x ➖
  • Best: random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer (0.879x)
  • Worst: random-access/nested-lists/correlated/vortex-tokio-local-disk-footer (1.356x)
  • Significant (>10%): 1↑ 2↓
Detailed Results Table
name PR 7031246 base 8e92de5 ratio (PR/base) unit remark
random-access/parquet-tokio-local-disk 185454814 1.86617e+08 0.993773 ns
random-access/parquet-tokio-local-disk-footer 184837257 1.85581e+08 0.99599 ns
random-access/taxi/correlated/parquet-tokio-local-disk 275805071 2.77805e+08 0.992802 ns
random-access/taxi/correlated/parquet-tokio-local-disk-footer 276395098 2.78419e+08 0.99273 ns
random-access/taxi/uniform/parquet-tokio-local-disk 291249816 2.95385e+08 0.986 ns
random-access/taxi/uniform/parquet-tokio-local-disk-footer 294620173 2.90829e+08 1.01304 ns
random-access/vortex-tokio-local-disk 1243628 1.33276e+06 0.933119 ns
random-access/vortex-tokio-local-disk-footer 1258198 1.34484e+06 0.935577 ns
random-access/taxi/correlated/vortex-tokio-local-disk 1642028 1.71361e+06 0.958228 ns
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1647592 1.72079e+06 0.957465 ns
random-access/taxi/uniform/vortex-tokio-local-disk 4773122 4.94184e+06 0.965859 ns
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4737175 4.89683e+06 0.967397 ns
random-access/lance-tokio-local-disk 754620 738811 1.0214 ns
random-access/lance-tokio-local-disk-footer 1361505 1.35325e+06 1.0061 ns
random-access/taxi/correlated/lance-tokio-local-disk 980798 965587 1.01575 ns
random-access/taxi/correlated/lance-tokio-local-disk-footer 1671616 1.66918e+06 1.00146 ns
random-access/taxi/uniform/lance-tokio-local-disk 8568295 8.64152e+06 0.991527 ns
random-access/taxi/uniform/lance-tokio-local-disk-footer 9237063 9.36058e+06 0.986804 ns
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14046862243 1.4051e+10 0.999703 ns
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13550930594 1.36021e+10 0.996237 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13578944483 1.35882e+10 0.999322 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13548965632 1.35324e+10 1.00123 ns
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7342803 7.60359e+06 0.965702 ns
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 5653548 6.43487e+06 0.87858 ns 🚀
random-access/feature-vectors/uniform/vortex-tokio-local-disk 11319912 1.23672e+07 0.915318 ns
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 11352125 1.26122e+07 0.900091 ns
random-access/feature-vectors/correlated/lance-tokio-local-disk 2816021 2.42648e+06 1.16054 ns 🚨
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1290718 1.28721e+06 1.00273 ns
random-access/feature-vectors/uniform/lance-tokio-local-disk 1439769 1.48445e+06 0.969899 ns
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2343910 2.39212e+06 0.979846 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk 159769125 1.58147e+08 1.01026 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 158940046 1.59911e+08 0.993928 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk 159350600 1.62757e+08 0.979071 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 159730697 1.64071e+08 0.973544 ns
random-access/nested-lists/correlated/vortex-tokio-local-disk 623895 640654 0.973841 ns
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 862267 635929 1.35592 ns 🚨
random-access/nested-lists/uniform/vortex-tokio-local-disk 2558460 2.71359e+06 0.942832 ns
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2616188 2.74756e+06 0.952184 ns
random-access/nested-lists/correlated/lance-tokio-local-disk 276209 275269 1.00341 ns
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 722353 725195 0.996081 ns
random-access/nested-lists/uniform/lance-tokio-local-disk 1162782 1.18725e+06 0.97939 ns
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1665743 1.68027e+06 0.991355 ns
random-access/nested-structs/correlated/parquet-tokio-local-disk 29209503 2.56739e+07 1.13771 ns 🚨
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 29159881 2.54593e+07 1.14535 ns 🚨
random-access/nested-structs/uniform/parquet-tokio-local-disk 28953117 2.56141e+07 1.13036 ns 🚨
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 28913947 2.55929e+07 1.12976 ns 🚨
random-access/nested-structs/correlated/vortex-tokio-local-disk 941897 779478 1.20837 ns 🚨
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 888000 894946 0.992239 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk 1478813 1.52556e+06 0.969356 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1495087 1.53754e+06 0.972388 ns
random-access/nested-structs/correlated/lance-tokio-local-disk 433846 438857 0.988582 ns
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 647038 652741 0.991263 ns
random-access/nested-structs/uniform/lance-tokio-local-disk 2844360 2.94134e+06 0.96703 ns
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3105038 3.18524e+06 0.974819 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 11, 2026

Benchmarks: Compression

Summary

  • Overall: 0.997x ➖
  • Vortex: 1.008x ➖
  • Best: vortex:parquet-zstd ratio decompress time/Food (0.937x)
  • Worst: vortex:parquet-zstd ratio decompress time/HashTags (1.079x)
  • Significant (>10%): 0↑ 0↓
Detailed Results Table
name PR 7031246 base 8e92de5 ratio (PR/base) unit remark
parquet_rs-zstd compress time/taxi 1.39287e+09 1.39366e+09 0.999434 ns
parquet_rs-zstd decompress time/taxi 2.8652e+08 2.86761e+08 0.999161 ns
compress time/taxi 6.90805e+08 7.17041e+08 0.96341 ns
decompress time/taxi 2.09202e+07 1.96794e+07 1.06305 ns
parquet_rs-zstd compress time/Arade 2.50867e+09 2.55476e+09 0.981962 ns
parquet_rs-zstd decompress time/Arade 6.5015e+08 6.59658e+08 0.985586 ns
compress time/Arade 1.08937e+09 1.11483e+09 0.97716 ns
decompress time/Arade 3.14938e+07 3.09729e+07 1.01682 ns
parquet_rs-zstd compress time/Bimbo 1.58595e+10 1.59097e+10 0.996846 ns
parquet_rs-zstd decompress time/Bimbo 2.2335e+09 2.28228e+09 0.978627 ns
compress time/Bimbo 6.69904e+09 6.81267e+09 0.98332 ns
decompress time/Bimbo 1.01376e+08 9.99358e+07 1.01441 ns
parquet_rs-zstd compress time/CMSprovider 7.84192e+09 7.86878e+09 0.996587 ns
parquet_rs-zstd decompress time/CMSprovider 2.11534e+09 2.12853e+09 0.993802 ns
compress time/CMSprovider 2.84307e+09 2.82629e+09 1.00594 ns
decompress time/CMSprovider 8.57507e+07 8.48899e+07 1.01014 ns
parquet_rs-zstd compress time/Euro2016 1.43859e+09 1.45241e+09 0.990482 ns
parquet_rs-zstd decompress time/Euro2016 4.15564e+08 4.19011e+08 0.991773 ns
compress time/Euro2016 4.13838e+08 4.27374e+08 0.968327 ns
decompress time/Euro2016 2.28408e+07 2.21907e+07 1.0293 ns
parquet_rs-zstd compress time/Food 9.23692e+08 9.3456e+08 0.98837 ns
parquet_rs-zstd decompress time/Food 2.34672e+08 2.39699e+08 0.979026 ns
compress time/Food 3.73109e+08 3.71409e+08 1.00458 ns
decompress time/Food 9.04659e+06 9.8628e+06 0.917243 ns
parquet_rs-zstd compress time/HashTags 2.52392e+09 2.54711e+09 0.990896 ns
parquet_rs-zstd decompress time/HashTags 6.68129e+08 6.82017e+08 0.979637 ns
compress time/HashTags 9.12576e+08 8.97461e+08 1.01684 ns
decompress time/HashTags 9.03237e+07 8.54394e+07 1.05717 ns
parquet_rs-zstd compress time/TPC-H l_comment chunked 3.19462e+09 3.19893e+09 0.998655 ns
parquet_rs-zstd decompress time/TPC-H l_comment chunked 7.1294e+08 7.15166e+08 0.996887 ns
compress time/TPC-H l_comment chunked 1.28478e+09 1.26782e+09 1.01338 ns
decompress time/TPC-H l_comment chunked 4.69363e+07 4.5225e+07 1.03784 ns
parquet_rs-zstd compress time/TPC-H l_comment canonical 3.18198e+09 3.17222e+09 1.00307 ns
parquet_rs-zstd decompress time/TPC-H l_comment canonical 7.12653e+08 7.118e+08 1.0012 ns
compress time/TPC-H l_comment canonical 1.28503e+09 1.28214e+09 1.00225 ns
decompress time/TPC-H l_comment canonical 4.86318e+07 4.55729e+07 1.06712 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6.45042e+06 7.12812e+06 0.904926 ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2.50116e+06 2.61602e+06 0.956095 ns
compress time/wide table cols=100 chunks=1 rows=1000 1.49161e+07 1.57719e+07 0.945742 ns
decompress time/wide table cols=100 chunks=1 rows=1000 3.18377e+06 3.51347e+06 0.906159 ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 8.51768e+07 8.97985e+07 0.948533 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 2.93107e+07 3.05212e+07 0.960339 ns
compress time/wide table cols=1000 chunks=1 rows=1000 1.46768e+08 1.47718e+08 0.993572 ns
decompress time/wide table cols=1000 chunks=1 rows=1000 2.9231e+07 3.0248e+07 0.966376 ns
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 8.95255e+08 9.28467e+08 0.96423 ns
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 3.38828e+08 3.46163e+08 0.97881 ns
compress time/wide table cols=10000 chunks=1 rows=1000 1.44823e+09 1.46884e+09 0.985969 ns
decompress time/wide table cols=10000 chunks=1 rows=1000 2.89468e+08 3.15392e+08 0.917801 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6.67334e+06 7.07837e+06 0.942779 ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2.5553e+06 2.56934e+06 0.994532 ns
compress time/wide table cols=100 chunks=50 rows=1000 1.48829e+07 1.52222e+07 0.977706 ns
decompress time/wide table cols=100 chunks=50 rows=1000 3.24651e+06 3.22685e+06 1.00609 ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 8.73468e+07 9.23688e+07 0.945631 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 2.95072e+07 3.1388e+07 0.940077 ns
compress time/wide table cols=1000 chunks=50 rows=1000 1.50275e+08 1.52491e+08 0.985472 ns
decompress time/wide table cols=1000 chunks=50 rows=1000 2.94072e+07 2.99029e+07 0.983423 ns
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 8.80866e+08 9.15881e+08 0.96177 ns
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 3.34662e+08 3.41727e+08 0.979326 ns
compress time/wide table cols=10000 chunks=50 rows=1000 1.42736e+09 1.4397e+09 0.991426 ns
decompress time/wide table cols=10000 chunks=50 rows=1000 2.92049e+08 2.95721e+08 0.987582 ns
parquet size/taxi 5.58792e+07 5.58792e+07 1 bytes
vortex-file-compressed size/taxi 5.14591e+07 5.14591e+07 1 bytes
vortex:parquet-zstd size/taxi 0.920898 0.920898 1 ratio
vortex:parquet-zstd ratio compress time/taxi 0.495958 0.514503 0.963956 ratio
vortex:parquet-zstd ratio decompress time/taxi 0.0730147 0.0686266 1.06394 ratio
parquet size/Arade 3.05282e+08 3.05282e+08 1 bytes
vortex-file-compressed size/Arade 1.4286e+08 1.4286e+08 1 bytes
vortex:parquet-zstd size/Arade 0.46796 0.46796 1 ratio
vortex:parquet-zstd ratio compress time/Arade 0.43424 0.436374 0.99511 ratio
vortex:parquet-zstd ratio decompress time/Arade 0.0484408 0.0469529 1.03169 ratio
parquet size/Bimbo 3.88935e+08 3.88935e+08 1 bytes
vortex-file-compressed size/Bimbo 5.26136e+08 5.26136e+08 1 bytes
vortex:parquet-zstd size/Bimbo 1.35276 1.35276 1 ratio
vortex:parquet-zstd ratio compress time/Bimbo 0.422399 0.428209 0.986431 ratio
vortex:parquet-zstd ratio decompress time/Bimbo 0.045389 0.0437878 1.03657 ratio
parquet size/CMSprovider 3.84635e+08 3.84635e+08 1 bytes
vortex-file-compressed size/CMSprovider 4.49523e+08 4.49523e+08 1 bytes
vortex:parquet-zstd size/CMSprovider 1.1687 1.1687 1 ratio
vortex:parquet-zstd ratio compress time/CMSprovider 0.362547 0.359178 1.00938 ratio
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0405375 0.0398819 1.01644 ratio
parquet size/Euro2016 1.23043e+08 1.23043e+08 1 bytes
vortex-file-compressed size/Euro2016 1.67865e+08 1.67868e+08 0.999984 bytes
vortex:parquet-zstd size/Euro2016 1.36428 1.36431 0.999984 ratio
vortex:parquet-zstd ratio compress time/Euro2016 0.287669 0.294251 0.977632 ratio
vortex:parquet-zstd ratio decompress time/Euro2016 0.0549634 0.0529597 1.03783 ratio
parquet size/Food 3.61776e+07 3.61776e+07 1 bytes
vortex-file-compressed size/Food 4.4164e+07 4.4164e+07 1 bytes
vortex:parquet-zstd size/Food 1.22075 1.22075 1 ratio
vortex:parquet-zstd ratio compress time/Food 0.403932 0.397416 1.0164 ratio
vortex:parquet-zstd ratio decompress time/Food 0.03855 0.0411466 0.936894 ratio
parquet size/HashTags 1.33855e+08 1.33855e+08 1 bytes
vortex-file-compressed size/HashTags 1.98976e+08 1.98976e+08 1 bytes
vortex:parquet-zstd size/HashTags 1.4865 1.4865 1 ratio
vortex:parquet-zstd ratio compress time/HashTags 0.361571 0.352345 1.02618 ratio
vortex:parquet-zstd ratio decompress time/HashTags 0.135189 0.125275 1.07914 ratio
parquet size/TPC-H l_comment chunked 1.58411e+08 1.58411e+08 1 bytes
vortex-file-compressed size/TPC-H l_comment chunked 1.80435e+08 1.80435e+08 1 bytes
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13903 1.13903 1 ratio
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.40217 0.396327 1.01474 ratio
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0658349 0.0632371 1.04108 ratio
parquet size/TPC-H l_comment canonical 1.58411e+08 1.58411e+08 1 bytes
vortex-file-compressed size/TPC-H l_comment canonical 1.80435e+08 1.80435e+08 1 bytes
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13903 1.13903 1 ratio
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.403848 0.404178 0.999182 ratio
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0682405 0.0640249 1.06584 ratio
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1 bytes
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0.948702 0.948702 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2.31243 2.21263 1.04511 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1.27292 1.34306 0.947771 ratio
parquet size/wide table cols=1000 chunks=1 rows=1000 9.322e+06 9.322e+06 1 bytes
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8.82958e+06 8.82958e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.947177 0.947177 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.7231 1.64499 1.04748 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.99728 0.991049 1.00629 ratio
parquet size/wide table cols=10000 chunks=1 rows=1000 9.322e+07 9.322e+07 1 bytes
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 8.83176e+07 8.83176e+07 1 bytes
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.94741 0.94741 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.61767 1.58201 1.02255 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.854321 0.91111 0.937671 ratio
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1 bytes
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0.948702 0.948702 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2.2302 2.15053 1.03705 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1.2705 1.2559 1.01163 ratio
parquet size/wide table cols=1000 chunks=50 rows=1000 9.322e+06 9.322e+06 1 bytes
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8.82958e+06 8.82958e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.947177 0.947177 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.72045 1.65089 1.04213 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.996613 0.952686 1.04611 ratio
parquet size/wide table cols=10000 chunks=50 rows=1000 9.322e+07 9.322e+07 1 bytes
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 8.83176e+07 8.83176e+07 1 bytes
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.94741 0.94741 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.6204 1.57193 1.03084 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.872667 0.865372 1.00843 ratio

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@joseph-isaacs joseph-isaacs joseph-isaacs left review comments

@robert3005 robert3005 robert3005 approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@onursatici @robert3005 @joseph-isaacs